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ABSTRACT 



Failing software development projects are plaguing the Department of Defense and 
other Federal service agencies today. Compounding this fact, the complexity of today's 
software projects makes it extremely difficult to isolate the underlying problem areas The 
System Dynamic Model (SDM), a quantitative tool that simulates software development 
life cycles, enables us to investigate these problem areas as well as many other pertinent 
areas It allows the isolation and manipulation of management variables allowing analysis 
which in turn leads to a better understanding of the effects variables have on projects 
This thereby presents an opportunity to suggest solutions. 

This thesis uses this System Dynamic Model's gaming interface to investigate the 
effects of time delays on software project management. Specifically, this experiment 
focuses on how software project managers compensate for assimilation and hiring delays 
inherent to a single project environment. The effect of these delays are measured in terms 
of staffing level decisions, final cost, and project completion 
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I. INTRODUCTION 



A. BACKGROUND 

Within the Department of Defense (DOD), as well as many other Federal service 
agencies, a critical problem exists concerning software development and management. 
Software projects that are over budget and behind schedule are commonplace and it seems 
conceivable that this trend will continue if we do not determine the causes and strive to 
resolve them. Managers of these projects are continuously blamed for the failure, but 
seldom given direction to correct the situation. 

Two of the most crucial project components the project manager is concerned with 
are people and money. The various idiosyncrasies of people and the constant flux in 
project budgets cause difficult problems for the manager who always needs more people 
than his money can buy. 

What then can we do to help these managers come to grips with this problem? 
One focus is to break apart the various decision areas the manager is involved with and 
analyze the various options. Through this evaluation, perhaps we might isolate and better 
understand each area and provide managers with the proper direction they should follow 
or at least clear up the gray areas to clarify their role. 

A comprehensive simulation model that addresses the dynamics of software 
development has been developed at the Naval Postgraduate School [Ref. 1] and provides a 
platform for experimentation. This Systems Dynamics Model (SDM) allows the 
manipulation of one or several factors while holding others constant so we may study the 



decision making process in segments. Through the simulation of software project 
management scenarios, we are able to isolate several decision processes concerning 
scheduling, staffing and productivity. These results then can be analyzed to see what 
impact the decisions had on the project. 

One area of research to be studied is that of staffing decisions. Project managers 
are continuously faced with difficult manning decisions that seriously affect the project's 
schedule and budget. Within this staffing area, managers are faced with delays in hiring 
and assimilating personnel into the project and often make the decision to hire late in the 
life cycle to bring the project to a successful completion. The problem of such late hiring 
has been stated clearly in Brooks Law. "Adding people to a late project makes it later" 
[Ref. 1], 

Through the analysis of various management scenarios we can focus on what 
information managers use to make different staffing decisions. By comparing projects with 
different time delay periods we can better understand where the decision process 
concerning late staffing gets derailed. 

B. PURPOSE OF RESEARCH 

The purpose of this thesis is to design, develop, and then execute an experiment 
using a single project management environment using the Systems Dynamic Model (SDM) 
gaming interface. The objective of the experiment is to examine the effects of assimilation 
and hiring delays on managerial staffing decisions. Even though research has been 
conducted into the affects of delays on decision making [Ref. 2] , no study on the effects 
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of delays on staffing software projects using this type of tool has been performed and 
analyzed. 

C. SCOPE OF RESEARCH 

The scope of this research is the design, construction, and execution of the systems 
dynamic model/gaming interface using a single project environment that has been 
specifically designed to isolate the staffing variable. A group of experimental subjects was 
divided into four groups (A-D) working on the exact same simulated project. The only 
differences among the groups were varying assimilation and hiring delay time periods that 
was described in the documentation provided to each group. Great care was taken to 
insure that each of the four tested groups were administered the exact same project to 
manage, and to insure that each participant had no idea of what the other participants were 
working on. 

D. LIMITATIONS 

The participants studied for this experiment were graduate students in their fifth 
quarter of an eight quarter preparation, graduate and subspecialty education program 
leading to a MS degree in Information Technology Management at the Naval Postgraduate 
School in Monterey, California. Although these students were not in fact software project 
managers, the amount of education in software project management and related subjects 
provided thus far in their curriculum, coupled with general management experience in their 
careers, suggests that they are appropriate surrogates for real life software managers. This 
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is further supported by findings of Williams Remus in his research of using graduate 
students for experimental studies [Ref. 3], 

E. THESIS ORGANIZATION 

Chapter II is an in-depth description of the experiment's organization, its 
methodology, and experimental group. Chapter III describes the various software files 
and the design of the documentation, as well as the construction considerations taken into 
account during the creation of the experiment. The chapter also covers the trial experiment 
and outcomes. Chapter IV analyzes the results and validates the findings. Chapter V is a 
summery of the prominent accomplishments and findings presented in chapters II-IV as 
well as suggestions for further research. 
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11. PREPARATION OF GAME INTERFACE 



A. EXPERIMENTAL DESIGN 

Just like a flight simulator aids a pilot in simulating flight environments, the 
Systems Dynamic Model (SDM) aids in simulating the life of a real software project for 
software project managers. The model simulates a software development project 
environment beginning with the "Design" phase and ending with the completion of the 
"Testing" phase. 

For this experiment, a single research question was isolated for examination: Do 
software project managers compensate for hiring delays and/or assimilation delays in their 
staffing decisions? The experiment focuses on how managers handle the hiring and 
assimilation delays inherent to their particular projects, and how the decisions they make 
concerning these delays are reflected in their staffing decisions. 

In the experiment, participants assume the role of software project managers. 
They are tasked to use information, gleaned from reports generated by the model every 
two calendar months (forty working days), in conjunction with their knowledge of the 
hiring and assimilation delays inherent to their project, to update the project's staffing 
level. They can either: 1) increase the staff level, essentially hiring personnel; or 2) 
decrease the staff level, essentially firing personnel; or 3) do neither by maintaining their 
current staff level. The overall goal for each manager is to complete the project on 
schedule and within budget. A sample report is illustrated in Figure 2-1 . 
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CURRENT INTERVAL STATISTICS: Elapsed Time = 40 


INITIAL ESTIMATES: (These will not change throughout the project) 


Project Size 


397 


Tasks 


Project Cost 


1,111 


Person-Days 


Project Duration 


320 


Days 


REPORTED STATISTICS at Time 


> 


40 Days 


Updated Estimate of Total Project Size 


0 


Tasks 


% Development Reported Complete 


45 


Percent 


Total Person Days Expended to-date 


684 


Person Days 


New Est of Project Duration (start-end) 


285 


Days 


Time Remaining 


280 


Days 


Current Staff Size 


5.00 


People 


Percent of Workforce that is Experienced 


70 


Percent 


PRESS <ENTER> TO VIEW THE GRAPHICALLY DISPLAYED VARIABLES 



Figure 2-1 Sample report, generated every 40 working days 



To compare the varying managerial decisions, each participant was assigned 
randomly to one of four groups (A-D). Each group was in turn assigned different 



assimilation and hiring delays. Figure 2-2 illustrates these delays. 



DELAYS BY GROUP ( I N DAYS) 




A B C D 

PROJECT 



Figure 2-2 Assimilation and Hiring delay differences by Group 
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The actual names assigned for this experiment were Projecta, Projectb, Projectc, and 
Projectd. As illustrated in figure 2-2, Group A was assigned maximum assimilation and 
hiring delays (80 days for assimilation, 60 days for hiring), group B maximum assimilation 
delay only (80 days for assimilation, 12 days for hiring), group C maximum hiring delays 
only (9 days for assimilation, 60 days for hiring), and Group D minimal hiring and 
assimilation delays (9 days for assimilation, 12 days for hiring). 

Throughout this chapter, the symbol ? will be used to identify generic file reference 
to the four projects, (i.e. Project7.BAT). This experiment was created using data 
collected from a real NASA project. This is advantageous in that it allows for 
measurement and comparison against a known baseline. 

Each participant was provided a folder with documentation pertaining to his/her 
randomly assigned group and a disk containing the group's software. The independent 
variables were the hiring and assimilation delays described in the documentation provided 
within each folder. The dependent variables were the staff level, project cost, and 
completion time. These folders are discussed later in the chapter as well. 

All participants had prior experience with the SDM interface in a previous course 
in a slightly different context. To ensure that they were comfortable with the simulation, a 
sample report was provided along with a 30 minute review of project management. The 
participants were also told that a "TEST" run would be accomplished by each participant 
just prior to the actual simulation. This simulation, called "TEST", and it's 
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documentation, mirrored the experiment simulation with the exception of the default staff 
level and project duration. 

Participants were not paid monetarily, but were told that they would be assigned a 
grade based on their performance. This was to insure that they would be serious and 
diligent in their participation Disclosure of experiment specifics was held until the day of 
the experiment so as to better control the knowledge base of the participants. 

B. THE SOFTWARE 

There were two primary efforts in the design of the experiment's software, the 
software interface, and the instructions for its use. Much care was taken to ensure the 
interface was both easy to use and clear in it's purpose. For each screen, detailed written 
and on screen documentation was provided to ensure total comprehension of the 
environment. The purpose of this was to ensure that the participants were capable of 
using the interface without having to worry about how the simulation works 

1. Software Interface 

The SDM software includes the DYN simulator as well as DYNEX files which 
help model the interface. The DYNEX file, Proj?.DNX, provides three primary 
functions: 1) it displays information on the screen to the participant; 2) it captures the staff 
variable input; and 3) it provides an output format for the simulations reports. A copy 
of the DYNEX file is provided in appendix A. 

The DYNEX file works directly with the Project7.BAT batch file This batch file 
is the primary control file for the entire user interface, and is common to each group 
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project This file directs a basic set of files that inter-operate and control the whole 
simulation Figure 2-3 illustrates the overall architecture. 




Figure 2-3 Flowchart of basic set of project files 

The Project 7 . BAT invokes the interface, prompts the DYNEX file to provide 

instructions during each simulation, and controls the display of the status reports as well as 

the initiation of the next set of inputs. A copy of this batch file is provided in appendix B. 

Paramount to the design process was the ability to capture data to files for later 

analysis. This was done using various OUT files each feeding or storing information as 

needed. These OUT files greatly enhanced later analysis in that they worked collectively 

to capture critical variable data, especially the staff level (WFS), input by the participant 

into a cumulative file called INFO for each participant. Figure 2-4 illustrates the INFO file 

for one participant. These INFO files were later combined for all participants for analysis. 

As illustrated in this figure, eighteen variables were captured using the various .OUT files 

and input into appropriate columns. The numerical data in this figure was excerpted from 



9 



a single participants file, however, the column names were added to identify each variable 
captured. Definitions of these variables can be found in the variable initialization portion 
of the SAS Control file in appendix M. 
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Figure 2-4 Sample of single participants INFO file with added identifiers 



Furthermore, timestamp and capture files were included in the simulation to 
capture the time passage during each of the participants decision intervals. This 
TIMESTMP feature was transparent to the participant as they had no idea they were 
being timed on their decisions. Figure 2-5 shows these files as they are encountered 
within the Project? BAT file. This feature works in the following sequence: at the start of 
the decision cycle, when the report, shown in figure 2-1, is viewed by the participant, the 
TIMESTMP file copies the computer clock time to a temporary file; when the participant 
completes the interval, the Project7.BAT file loops back to the beginning of the reporting 
sequence (-top) and updates the simulation files with the new staff level; the CAPTURE 
file then takes the current clock time, compares it to the temporarily stored TIMESTMP 
time, and annotates the difference, in seconds, to the INFO file under the column TIME 
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Figure 2-5 illustrates the proper placement of these two files within the Project7.BAT file 



Since the placement of the CAPTURE file needed to come before the looped TEMESTMP 



file, an initial TEMESTMP was placed before the CAPTURE file, outside the loop, to feed 



it a time, thus this time period has no bearing in the analysis. The entire .BAT file can be 



viewed in appendix B. 



echo off 
CLS 
init 1 

GRAPHICS 
bat /N /p /s 

smlt PROJA -go = -prs = -Is -ns -plm 6 -bw 

rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 

rep PROJA INTRVAL -outf INTRVL. OUT -bw >NUL 

rep PROJA -t -bw >NUL 

timestmp 

-top dynex PROJA -in PROJA. STT -sc -Is -plm 6 -bw 
smlt PROJA -gm = -ns -plm 6 -bw 
capture 

rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL.OUT -bw >NUL 
rep PROJA -bw >NUL 
call -topi 
Exit 

goto -top%A 

-topi timestmp 
%A = 1 
ram 
els 



Figure 2-5 Excerpt form Project7.BAT file showing timestmp feature 



This time data allowed the designer to analyze decisions made over time both. 



within and between groups. This information is presented later in chapter IV. 



In all, 27 files, including the base set illustrated in figure 2-3, were needed to 



conduct the experiment. Figure 2-6 lists these necessary files. 
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PROJECT 0 . BAT - Directly controls user interface 

TEST.BAT - Directly controls user interface for test portion 

IN1T.EXE - Asks for student name and SMC box for identification 

BAT COM - Controls BAT files within simulation 

DYNEX EXE - Allows execution of DYNEX files 

SMLT.EXE - Primary DYNAMO execution file 

REP. EXE - Generates specified report formats 

INFOOB.EXE - Strips data from numerical screen inputs 

rNFO - Collects all report data stripped from INFOOB.EXE 

JUNK. OUT - Feeds last report screen output to INFOOB.EXE 

INTERVAL. OUT - Contains copy of last output screen 

INTER VL.DRS - Screen report format 

PROJ ? CHG - DYNAMO generated file 

PROJ7.DAT - DYNAMO required file 

PROJ7.DNX - Project specific DYNEX file 

PROJ7.DRS - Project report file 

PROJ? DYN - Project DYNAMO file 

PROJ?. INS - DYNAMO required simulation file 

PROJ ? OUT - Captures project inputs from user 

PROJ7.RSL - DYNAMO generated file 

PROJ 7.SMT - DYNAMO required simulation file 

PROJ7.WAS - Temp storage for input variables 

PROJ7.STT - DYNAMO generated file 

PROFXPL'LDRS - Determines variables to be plotted 

TIME.TMP - Stores timing data generated by timestmp.exe 

TIMESTMP EXE - Inserts decision timing data from computers clock 

CAPTURE.EXE - Captures timing data for participant 



Figure 2-6 Project related files 

Though many variables came into play for this experiment, four primary variables 
were displayed to the participants in the reports and graphs generated by the simulation 
model. These were: (WFS) - the staff level requested by the participant; (FTEQWF) - 
the full time equivalent staff level; (FRWFEX) - the percent of the staff work force 
currently working on the project that are fully experienced; And lastly, (CMTRMD) - the 
cumulative person-days spent by experienced staff training the new staff 

2. Software Instructions 

To aid the participants in using the software, on screen documentation was 



provided as displayed in Figure 2-7 



*************************************** 

!!!! Important Points to Remember !!!! 
************************************** 

- You are not allowed to discuss this exercise with anyone 
other than a lab attendant. Please refrain from discussing 
this with members in the other class until they have completed 
the exercise. 

- The system will show you the size of the initial core team of 
software developers (the full time equivalent number). It will 
then ask you for your initial desired staffing level. Next it 
will run through the first simulation time period and show you 
the current reported statistics. Make your change to the 
desired full time equivalent staffing level on the documentation 
sheet provided after reviewing the report. There is no need to 
turn in the documentation sheet after each interval. 

A LAB ATTENDANT MUST VERIFY YOUR FINAL RESULTS! 

- GOOD LUCK! Press <ENTER> to continue. 

Figure 2-7 Initial screen seen by participant 

Following this introduction screen, the participant is shown the initial staffing screen as 
displayed in Figure 2-8. 



THE INITIAL CORE TEAM OF SOFTWARE 
DEVELOPERS HAS BEEN SET AT: 

3.5 Full time equivalent Personnel 

1) Press <ENTER> to keep that same 3.5 full time equivalent staff. 

OR 

2) Enter your initial desired staffing level and press <ENTER>. 
[Remember, you are working in full time equivalent personnel ] 



Figure 2-8 Initial staffing screen as viewed by participant 

This screen is the first time the participant is shown the initial staff size as provided by the 
software. 

As a follow on to the report, and as indicated at the bottom of the report screen 
in figure 2-1, a graphic display immediately followed the report plotting the report 
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information This was a hardwired feature that intentionally could not be bypassed Figure 
2-9 illustrates the four graphically plotted variables that were displayed on the screen and 
in the documentation to aid the participants better understand what is being displayed 



GRAPHICALLY DISPLAYED VARIABLES 
THE FOLLOWING VARIABLES WILL BE PLOTTED: 



WFS STAFF LEVEL YOU REQUESTED 

FTEQWF CURRENT STAFF LEVEL 

FRWFEX PERCENT OF STAFF THAT IS EXPERIENCED 

CMTRMD CUMULATIVE PERSON-DAYS SPENT ON 

TRAINING NEW STAFF 



AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE 
PRESS <ENTER> TO VIEW PLOT 



Figure 2-9 Plot variable information as viewed by participant 



After viewing the graph, the participant, through use of a short menu screen, was 



given two options: 1) review the report and graph again; or 2) move to the next interval 



The purpose here was to insure the participant had full access to the information to make 



decisions prior to moving to the next interval. 

The graph is displayed for the participant following this screen The graph is 
depicted with the Y-axis displaying the numeric variable levels as shown in the report, and 
the X-axis depicting time in forty day intervals that appear incrementally following each 
successive interval. Numeric upper limits were carefully tested to insure plot information 
could be calculated given unusual staff level input. 
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C. THE DOCUMENTATION 

Creating the written documentation for this experiment was an important part in 
ensuring the experiment's success. In order to eliminate any external bias in the 
experiment, it was imperative that the computer interface be maintained exactly the same 
for all groups. This resulted in the documentation being the only means for conveying the 
unique delay information to the participant. With this in mind, two primary areas were 
addressed. 

The first area provided clear and extremely detailed procedures for the participant 
to follow in setting up and conducting the experiment. These procedures fell into three 
categories: 1) how to insert the disk and boot the experiment up; 2) how to initiate the 
TRIAL (TEST) run, this area also described in detail what each sequential screen was 
asking and/or displaying, and how to input the proper response or decision for that 
screen; and 3) how to run the actual experiment itself, this area included a description of 
indicators that would be encountered when the simulation was nearing completion. A 
copy of this documentation is contained in appendix D. 

The second area concerning the documentation was the most critical in that this 
was where the delays were described to the participants. Though the purpose of the 
experiment, as far as the participant was concerned, was to complete the project on time 
and on budget, the actual experiment itself rested solely on the way they handled the 
information about the delays described within their documentation. Copies of the project 
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specific sets are contained in appendices E through H. Figure 2-10 shows a 
documentation excerpt. 



SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR ESTIMATES: 

Your primary task is to update the project's staffing level. Every 
two-month(40 working days) reporting period, you will have the option to 
adjust the Project's staff level. You may find however, that the actual staff 
level in the status report is somewhat different from the staff level you 
chose. This will be due to things you cannot totally control such as delays in 
hiring. 

Because all personnel in the organization are already assigned to other 
projects, any staff additions you request will be hired from the outside. As a 
result, there will be a delay in hiring new staff and in assimilating them into 
your project. 

- The hiring delay will be 3 months (i.e., 60 working-days) on average. 

- The assimilation delay for a newly hired employee is typically 4 months 
(i.e., 80 working-days). This is the time it typically takes to train a new 
employee in the mechanics of the project and bring him/her up to speed. 

Because the organization does not have a formal training program, the 
training is done on the job by having one of the experienced staff members 
spend 25% of his/her time "hand-holding" the new employee. During this 4 
month training period, a new employee is typically only half as productive as 
an expenenced employee. 

Figure 2-10 Excerpt from ProjectA documentation concerning delays. 

This documentation was provided to ensure that the participants were completely 

aware of these delay periods. Care was taken to write the documentation in such a way 

as to focus their attention towards this information, and was captioned as being 

information important to the experiment. 

Other related documentation contained information needed by the participant to 
be totally aware of their responsibilities and to ensure the knowledge each participant had 
prior to the simulation was equal concerning their respective groups. Figure 2-1 1 shows 
this documentation. 
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PROJECT 

The project that you will manage happens to have been a real project conducted in a real 
organization. The particular organization is on the leading edge in software engineering 
technology. For the project, you will be given a project profile containing the following 
initial information: 

Estimated Project Size (in Number of Tasks*) 

Estimated Project Cost (in Number of Person Days) 

Estimated Duration (in Number of Work Days) 

Size of the Initial Core Team (in People**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements' specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 

YOUR TASK 

Your objective in setting the staffing level should be to finish on schedule 
while avoiding a cost overrun. Specifically you should: 

a) complete the project on schedule. 

b) at the lowest possible cost. 

Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt you. 
since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 

Figure 2-11 Excerpt form Project A showing delay information 

Though the data was captured to .OUT files, the designer thought it necessary to 

maintain a Decision Record Sheet to manually record the staffing decisions the 

participants made during the simulation. This allowed for backup of this critical data as 

well as certification of the data should the need arise. This record sheet is provided in 

appendix K. 

D. TRIAL EXPERIMENT 

Once the gaming interface and documentation was complete, a trial experiment 
was conducted to provide feedback on any problems that may be encountered by the 
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participants. Two students were chosen to participate in the trial experiment based on 
their understanding of personal computers and their abilities to properly critique this type 
of interface The objective of the trial run was to allow observation of the participants 
interaction with the simulation environment and the documentation. Based on the 
students participation in this trial run, they were also chosen as lab assistants for the actual 
experiment. This was advantageous in that they would have prior insight into the 
simulation environment and would be able to provide useful guidance in the absence of the 

designer. The specific concerns the designer was attempting to examine were: 

- Are the participants comfortable with the gaming environment? 

- Are the instructions clear? 

- What type of questions do the lab assistants and the designer need to 
prepare to answer for the participants? 

- How long does the experiment take on average? 

Following are the majority of observations made during the experiment trial run 



Both participants started the boot procedure without reading the start up 
documentation. Since the actual experiment will be conducted in a lab where machines 
boot up to a initial network screen, participants will have to be briefed to follow 
instructions explicitly as they may enter the network inadvertently. The two participants 
were briefed to read the instructions carefully. 

It was noted that when viewing the plot following the first interval, with no change 
being made to the staffing level, the lines overlapped each other making it difficult to 
comprehend what the plot was showing. This was later remedied by briefing the 
participants that if they choose not to change the staff level the first time around, they will 
see flat overlapping lines depicting no change for the time period. 

One participant tried to bypass the plot and found he could not, he indicated that it 
was irritating that he could not just review the report without the plot. 
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Both subjects spent an excessive amount of time on the TEST portion of the 
experiment. This posed a potential problem in that the participants may try to learn the 
system too deeply prior to going onto the experimental phase so as to maximize their 
grade. 

One participant asked if, when the given staff level 3.5, would entering 4.5 mean 
that he had added one person? The partial person criteria will have to be briefed to the 
actual participants to ensure they are aware of how the simulation model calculates the 
staff level. 

One participant noted that due to the excruciating slow speed of operating off of 
the disk rather than the hard drive, the participants are apt to begin to talk amongst 
themselves. 

The participants took different approaches to solving the staffing level. One 
calculated the level using the established staffing equations, the other operated on intuition 
alone. 



The participant operating intuitively finished after one hour seventeen minutes 
At one hour forty five minutes, the remaining participant completed the project. 

E. FINAL PREPARATIONS 

Having completed the software development, the written documentation, and the 
incorporation of lessons learned from the trial experiment, the final preparations 
commenced. 

Individual folders were developed for each participant The documentation was 
specifically titled according to the appropriate group (A-D) and placed in folders titled for 
that particular group. Group disks were made up and annotated with the group letter and 
taped into a protective cover inside the folder. Once a participant had been randomly 
assigned to each of the four groups, their individual names were then assigned to a 
particular folder and disk for control purposes. This random sample will be discussed in 
chapter III. The experiment documentation provided each group was identical with the 
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exception of the specific group BAT file was identified (i.e. ProjectA BAT) for input at 
the prompt when initiating the actual experiment. These were then filed in their respective 
folders. Lastly, a TEST and ACTUAL experiment staff level record was placed in each 
folder along with a pencil Participants were to arrive at the lab with nothing but a 
calculator. 

Two laboratories were identified for use. These labs were represented in a 
computer drawing with each computer assigned to a specific group so as to separate the 
participants within the same group by at least one seat. These identified computers were 
later assigned to specific participants who were positioned in such a way as to ensure that 
no two participants of the same group label were in eyesight of each others terminal 
screen LAB reservations were made and signs posted to keep non-participants from 
entering the lab during the experiment. Lab assistant folders were created and provided 
to the lab assistants. These folders contained seating arrangements, extra disks and 
documentation, pencils, etc.. Also specific instructions were provided as to what the 
attendants could and could not assist the participants with. In the later case they were 
directed to consult the designer before taking any action. This added additional control to 
the experiment environment. 
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UI. CONDUCTING THE EXPERIMENT 



A. TASKS AND PROJECT CHARACTERISTICS 

After a thirty minute review session, several days to review and learn the report 
format, and having had prior experience with the game interface, experiment participants 
were now more comfortable with the upcoming experiment. To ensure maximum 
preparation was given, participants were briefed that the TEST simulation was scheduled 
to be conducted immediately preceding the actual experiment. 

The simulation was designed to allow the participants to manage the simulation 
independently. Each participant was tasked to review reports and plots, and then update 
the project's staffing level every two calendar month (40 working days) interval until 
project completion. The participants used the interface to input their staffing level 
decision into the model thus modifying the model report output. The participants were 
told that their overall course grade would be impacted by their project's results. A 
statistical comparison of the grades indicated no statistical significance in the means across 
groups (F = 1.12; d.f.= 3; P > 0.351) 

B. ORGANIZING THE EXPERIMENT 

The experimental introduction consisted of a thirty minute classroom training 
session in which the documentation, seating arrangements, and experimental guidelines 
were discussed. This also provided an opportunity to settle any last minute questions that 
may have been generated. The size of the group required that two separate sessions, both 
requiring the use of two labs simultaneously, be provided. One lab assistant was assigned 
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to each of the two labs to provide the individual folders to the participant's and to 
provide general guidance to the participants during the experiment. Each participant was 
checked to ensure that their name was assigned to the folder and associated disk they 
received before starting the experiment. The lab assistants were instructed to ensure 
everyone started at the same time. As illustrated in appendix J, seating arrangements 
were predetermined. However, if machines were found to be inoperable, the lab assistants 
were to reassign participants ensuring that no two participants with the same group 
identifier were within screen view of each other. Lab assistants were briefed that no 
guidance on how to calculate the staffing levels or how to interpret the reports was 
allowed. Each lab assistant had back-up disks and documentation. The experiment was 
conducted in a single day. 

All lab machines were checked the day prior to the experiment. Lab reservations 
were confirmed and signs posted. A last minute briefing was provided to the lab assistants 
to ensure all matters were understood. The experiment designer monitored both labs, 
visiting each approximately every half hour. 

C. THE EXPERIMENTAL SUBJECTS 

Participants in this experiment were gathered from two segments of a Software 
Engineering and Management course, IS4300, at the Naval Postgraduate School 
Segment one consisted of 24 students, segment two had 27 students. In order to 
randomize the sample population and assign them to the four groups, the following 
matched sample procedure was used [Ref. 4], 
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An alphabetical list for each segment was used along with a standard table of 
random digits to perform a two-level randomization [Ref. 5], Appendix I includes the 
sample population randomizing worksheet used for each segment. Column A is the 
alphabetical listing of the participants in each segment. Column B is a two digit random 
number, taken from the standard table of random numbers [Ref. 5], assigned to each 
participant. The row of digits chosen was done randomly for each segment. Once the 
number was assigned, column C was generated listing the participants in numerical 
sequence. Column D then assigned the participants a number from 1 to 4 in a stepped 
sequential fashion (i.e. 1234, 2341, 3412, etc...). The final group randomization was 
accomplished by assigning the group letters A-D to these numbers by randomly assigning 
a letter to each number 1 through 4. In Column E, these letters were then assigned to the 
participant whose number was correlated with it. 

Prior to conducting the experiment, all participants were checked on the list to 
ensure they had received the advanced training by matching their name to an attendance 
sheet taken the day of the training session. It was determined that two participants did not 
receive this training and they were removed from the experiment. These participants are 
highlighted on the list in appendix I. 

D. DEPENDENT MEASURES 

There are three dependent variables. Information contained in this section can be 
referenced against figure 2-1 in chapter II. The first of these is the project cost as 
identified by the "Total Person Days Expended to Date" line. It represents the cost of the 
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project, in Person Days, at the end of the current interval Upon project completion, it 
represents total project cost. Project completion is normally indicated when the "% 
Development Reported Complete" is 100 percent. However, an 97 percent completion 
level, accompanied by a elapsed time interval that is not a 40 day multiple, also indicated 
completion. To ensure all participants completed the project, lab attendants verified that 
each participant getting a completion indictor completed one more interval with absolutely 
no changes made. They then compared the two intervals and if the exact same results 
were experienced the participant could log off. 

The second dependent variable measured was the project's completion time. This 
variable was reflected in the line "New Est of Project Duration (start-end)". This line 
reflects the estimated completion date at the end of each 40 day interval. The DYNAMO 
simulation determines this variable on the basis of the status of the project at a specific 
moment in time. It reflects the projected completion date as calculated by the current 
input. 

The third and final dependent variable was the actual staffing level input by the 
participants. Though this variable was captured to the INFO file, participants were 
requested to annotate written documentation sheets to provide a back up if necessary. 
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IV. EXPERIMENTAL RESULTS AND ANALYSIS 



A. MODEL OF ANALYSIS 

The raw data produced by this single project experiment was input to a file called 
INFO (figure 2-4) which contained, the final project cost, final completion time, 
chronological staffing decisions and other necessary information for each participant. Our 

analysis focused on three dependent variables: 

1) Participant performance concerning staffing decisions 

2) The absolute value of deviation by the participant from an established 
optimum 

3) The absolute value of the percentage deviation each subject incurred 
from the optimum 

Analysis of this data was conducted using the Statistical Analysis System (SAS). 
Specifically, the General Linear Model (GLM) procedure was used for multivariate 
analyses due to the unequal populations within the project groups. Appendix L illustrates 
the SAS control file from the demographic analysis, and appendix M shows the SAS 
control file used for the GLM and Repeated Measures analysis. This last file calculated 
two new variables, Doptimal and Poptimal. Doptimal represents the absolute deviation of 
the input staff levels for each subject in each interval in comparison to the optimal project 
staff level for that interval. Poptimal depicts the percentage deviation from the optimal 
staff level solution for each subject per interval. The following equations illustrate how 
these two variables are calculated: 
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DOPTIMAL, = Absolute value of (Subject Staffing Decision - Optimal Staffing Decision^ 

POPTIMAL t = Absolute value of (Subject Staffing Decision - Optimal Staffing Decision^ 

Optimal Staffing Decision 

t= time interval 
B. RESULTS 

1. StafTing Level Decisions 

For each of the four groups, the mean staffing level was determined and plotted 
against the project time periods. This is shown in figure 4-1 . 



STAFFING LEVEL DECISIONS 




Assim/Hinng -*-Assimonlv -*-Himgonly -B- No delays 

Figure 4-1 Staffing Level Decisions for each group 

A significant number of participants completed the project before the seventh 
period (Time=240). In order to minimize the problem of missing values, only the first six 
periods were evaluated. The figure illustrates that all four groups initially increased staff 
size responding to group specific information. 
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The assimilation and hiring group initially increased its staff size at the 40 day mark 
in response to the realization that the delays would have significant impact on the project 
At day 120, the assimilation and hiring group reduced staff size, but then increased back to 
the previous level at day 1 60 and beyond. 

The assimilation-only group increased staff size at the 40 and 80 day points as they 
responded to the realization that assimilation delays would cause the project to fall behind 
schedule if not compensated for at the beginning of the project As the project progressed 
and the staff became more fully assimilated, the participants began to stabilize the staff size 
trying to meet reported cost and schedule projections. Near the end of the projects 
lifecycle, they realized that these projections were not fully being met and hired more 
people. In accordance with 'Brook's Law' [Ref. 1], this decreased the likelihood of a 
successful completion as adding people to a late project makes it later. 

The hiring-only group initially hired staff and then remained steady responding to 
the project requirements with slight deviations of the staff levels. This indicates that the 
participants felt they had overcome the hiring delays early on and could maintain current 
staff levels. However, near the end of the project, they began reducing staff to meet cost 
and completion schedules. 

The no-delay group responded in a similar fashion to the hiring-only group They 
hired staff up front, and maintained a steady level reacting to the immediate affects their 
input had on the project reports. 
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In conjunction with figure 4-1, Table 4-1 illustrates the repeated measure analysis 
of the overall staffing level decisions. The Within Subjects results show a significant 
Period effect (P < 0.05), indicating that the individual participants made different 
decisions as time progressed. However, the interaction, or PROJECT* PERIOD effect 



Table 4-1 REPEATED MEASURE ANALYSIS OF STAFFING LEVEL DECISIONS 



Source of 
variation 


SS 


Degrees of 
Freedom 


F 


Significance 
of F 


Between Subjects 










Project 


11.01 


3 


0.41 


0 7478 


Subjects-within 










-Projects 


422.71 


47 






Within Subjects 










Period 


0.561 


5,43 


6.72 


0.0001 


Project*Period 


0.724 


15,119 


0.98 


04755 



is not significant (P > 0.05), indicating that the pattern of the decisions made was similar 
over time across the four groups. There was no significant difference Between Subjects, 
that is, the overall decisions of the subjects were not significantly different across the four 
groups (P > 0. 1). 

2. Deviation of staff levels from optimum (DOPTEMAL) 

Figure 4-2 illustrates the mean deviation of input staff levels from the optimum for 
each of the four project groups. As shown in this figure, assimilation and hiring group's 
staff level decisions deviated significantly from the optimal at day 80 of the projects 
lifecycle and continued to deviate for the remainder of the project This is due to the 
difficulty each participant encountered handling both the assimilation and hiring delays. 
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DEVIATION FROM OPTIMAL LEVELS 

(By Group) 




*■- Assim/Hiring •+ Assimonly -A- Hiring only ■& No delays 



Figure 4-2 Deviation from optimal staff levels for each project (Absolute Value) 

The assimilation-only group drastically deviated from the optimum at the 120 day mark. 
This drastic deviation was due to the participants inaccurate attempt to overcome the high 
assimilation delay inherent to their project. This group then abruptly shifted back towards 
the optimum at day 200 The hiring-only group differed from the assimilation and hiring 
group and the assimilation only group in that it followed the optimal path more closely 
As depicted earlier in figure 4-1 analysis, this is due to the more accurate attempt to 
counter the extreme hiring delays encountered. The no-delay group with minimal delays 
remained fairly steady along the optimal path as well. This is due to the simulation output 
giving immediate results the participants allowing them to modify the staff level more 
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accurately. There was a tendency at the end of the project to hire additional people to 
meet schedule and cost projections. This is common to most development projects. Table 
4-2 shows the repeated measures analysis of the overall deviation of staffing levels from 
their optimum solutions. 



Table 4-2 SUMMARY OF OPTIMAL SOLUTION DEVIATIONS REPEATED 
MEASURE ANALYSIS 



Source of 




Degrees of 




Significance 


variation 


SS 


Freedom 


F 


of F 


Between Subjects 










Project 

Subjects-within 


917.96 


3 


3.03 


0.0383 


-Cells 


4738.63 


47 






Within Subjects 










Period 


0.80 


5,43 


2.08 


0.0864 


Project*Period 


0.784 


15,119 


0.72 


0.7522 



The Within Subjects results indicate no significant Period effect (P > 0.05), indicating that 
the individual subjects made similar decisions as time progressed. Furthermore, the 
interaction or PROJECT*PERIOD effect, is not significant (P > 0.05), indicating that 
the pattern of the decisions made was similar over time between the four groups. There 
was significance Between Subjects with overall decisions of the subjects being 
significantly different across the four groups (P < 0.05). 

3. Percentage deviation of staffing level from Optimal (POPTIMAL) 

Figure 4-3 illustrates the percentage deviation of staff levels from the optimal for 
each group. 
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PERCENTAGE DEVIATION 

(From Project Optimal Levels) 



m^wwwvvvvv^M^UW»vvvvvvw>wa>wwvv^^W^^TOvwvvwwvwvvv^^ 




Figure 4-3 Percentage deviations between optimal and actual staff levels 
This figure indicates that the Assimilation-only, Hiring-only, and No-delay groups varied 
similarly, percentage-wise, from the optimal solutions. All three deviated more in the 
beginning then subsided toward the optimal. Only the assimilation and hiring delay 
group, varied severely throughout the project. This is due to the dynamic requirements the 
participants had of keeping track of the delays and their impacts on the project 
Participants in assimilation and hiring group had to battle significant delays displayed to 
them via the project reports and had great difficulty foreseeing the next intervals 
interaction The participants were unable to correctly isolate the optimal solution for 
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their projects. This is due to the burden managers face when juggling unpredictable 
information. 

Supporting figure 4-3, Table 4-3 illustrates the repeated measures analysis for the 
overall percentage deviation from the established optimal decision. The Within Subjects 
results indicate a non-significant Period effect (P > 0.05), indicating that the individual 



subjects made similar decisions as time progressed. 

Table 4-3 REPEATED MEASURE ANALYSIS OF PERCENTAGE DEVIATION 
FROM OPTIMAL 



Source of 




Degrees of 




Significance 


variation 


SS 


Freedom 


F 


of F 


Between Subjects 










Project 

Subjects- within 


7.02 


3 


8.87 


0.0001 


-Cells 


12.41 


47 






Within Subjects 










Period 


0.869 


5,43 


1.29 


0.2856 


Project*Period 


0.766 


15,119 


0.80 


0.6721 



Furthermore, the interaction or PROJECT*PERIOD effect, is not significant (P 
> 0.05), indicating that the pattern of the decisions made was similar over time between 
the four groups. These results indicate that the overall percentage deviation concerning 
staffing decisions was not significant across time (P > 0.05). However, a high Between 
Subjects effect indicates that the overall decisions of the subjects were different across the 
four groups (P < 0. 1). 
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V. CONCLUSIONS 



A. FINDINGS AND IMPLICATIONS 

The objective of this thesis was to conduct an experiment focused on gaining 

insight into the implications assimilation and hiring delays have on a single software 
project management environment. 

This information is critical in that the Department of Defense, as well as other 
Federal agencies, are fighting a continuous battle against project cost and schedule 
overruns and need to find ways to remedy the situation. Delays heavily impact staffing 
decisions throughout the project's life cycle and therefore require in-depth understanding. 
This thesis provides empirical findings regarding the project managers behavior when 
handling these delays. 

The experimental results confirm that excessive delays seriously affect the way a 
manager thinks and reacts concerning staffing decisions. Managers faced with significant 
assimilation and hiring delays often failed to handle them properly thereby creating adverse 
affects to the project. The overall findings of this research indicate that managers make 
better staffing level decisions when handling single delays then managers dealing with 
projects incurring multiple delays with significant delay periods. 

B. FURTHER RESEARCH 

There are several areas that can be potentially researched using the SDM model. 
One area to be researched could be to see if a team of managers could better foresee and 
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handle these associated delays. This could be done by replicating part of this experiment 
using teams of decision makers to see if the data changes significantly. 

Another area to be researched could be determining what information needs to be 
provided to a manager, and at what time during the project life cycle, to enhance the 
managers performance in handling delays. 

Lastly, perhaps evaluate the effects of delays on an multi-project environment. 
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APPENDIX A: DYNEX PROGRAM FILE (PROJ?.DNX) 



if #tm< 1 then 
display clear 

! ! ! ! Important Points to Remember ! ! ! ! 
************************************** 



- You are not allowed to discuss this exercise with anyone 
other than a lab attendant. Please refrain from discussing 
this with members in the other class until they have completed 
the exercise. 

- The system will show you the size of the initial core team of 
software developers (the full time equivalent number). It will 
then ask you for your initial desired staffing level. Next it 
will run through the first simulation time period and show you 
the current reported statistics. Make your change to the 
desired full time equivalent staffing level on the documentation 
sheet provided after reviewing the report. There is no need to 
turn in the documentation sheet after each interval. 

A LAB ATTENDANT MUST VERIFY YOUR FINAL RESULTS! 

- GOOD LUCK! Press <ENTER> to continue, 
dendq 
choice 1 
cend 1/1 
display clear 

THE INITIAL CORE TEAM OF SOFTWARE 
DEVELOPERS HAS BEEN SET AT: 



3.5 Full time equivalent Personnel 

1) Press <ENTER> to keep that same 3.5 full time equivalent staff. 

OR 

2) Enter your initial desired staffing level and press <ENTER>. 

[Remember, you are working in full time equivalent personnel.] 

The current staffing level = 
dendq 

35 



dq WFS1=0.5< 
display clear 

|******************************************************| 

| !! IMPORTANT !! | 

I _ I 

| Make sure that you have written your staffing | 

level decision down on the documentation sheet 
before continuing with the simulation 

I I 

I _ I 

| This is your final opportunity to check and 
| change the staffing level for this time period. | 

I I 

| Press <ENTER> to keep the displayed number | 

I OR | 

| Change the staffing level and then press <ENTER>. | 

I I 

U************^***********^**************^********J 

Your subsystem selected staffing level = 
dendq 

dq WFS1=0.5< 
else 

choice 1 
cend 1/1 
display clear 

* MAKE YOUR CHANGE TO THE DESIRED STAFFING LEVEL * 
******************************************** :*************** 



a) Press <ENTER> to keep the displayed staffing level. 

OR 

b) Enter the new desired staffing level and press <ENTER>. 
[Remember you are working in full time equivalent personnel] 

Your last desired staffing level was = 
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dendq 

dq WFS1=0.5< 
display clear 



!! IMPORTANT !! 

Make sure that you have written your staffing 

level decision down on the documentation sheet 

before continuing with the simulation. | 



This is your final opportunity to check and 
change the staffing level for this time period. 

Press <ENTER> to keep the displayed number 
OR 

Change the staffing level and then press <ENTER>. 






Your subsystem selected staffing level = 
dendq 

dq WFS1=0.5< 



end 

display clear 

* * 

* Press <ENTER> to run another interval and see the updated output. * 

* * 

jjj ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ 

dendq 
choice 1 
display clear 
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****************************************************************** 



* * 

* There will be a long pause as the system calculates your input! * 

* * 

****************************************************************** 

dendq 

report 

time=maxtime, 

Format="5<38<53<",PICTURE="Z,ZZ9V" 

"CURRENT INTERVAL STATISTICS:","Elapsed Time =",tm;; 

Format="5<" 

"INTITIAL ESTIMATES: (These will not change throughout the project)"; 
FORMAT="8<52<66<",PICTURE="ZZZ,ZZZV" 

"Project Size",IPRJSZ, "Tasks"; 

FORMAT="8< 52<66<",PICTURE="ZZZ,ZZZV" 

"Project Cost", TOTMDO, "Person-Days"; 
FORMAT="8<52<66<",PICTURE="ZZZ,ZZZV" 

"Project Duration", TDEV,"Days";; 

Format="5<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"REPORTED STATISTICS at Time = = = = = =>",tm,"Days"; 

FORMA T="8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"Updated Estimate of Total Project Size",PJBSZ,"Tasks"; 

FORMAT- '8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"% Development Reported Complete", PDVRC,"Percent"; 
FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"Total Person Days Expended to-date", CUMMD,"Person Days"; 
FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"New Est of Project Duration (start-end)", SCHCDT,"Days"; 
FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"Time Remaining", timerm,"Days"; 
FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V.99" 

"Current Staff Size",FTEQWF,"People"; 
FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"Percent of Workforce that is Experienced ",FRWFEX* 100,"Percent";, 
FORMAT="5<" 

"PRESS <ENTER> TO VIEW THE GRAPHICALLY DISPLAYED VARIABLES" 
cend 1/1 

spec md_length=#length+40 
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APPENDIX B: BATCH CONTROL FILE (PROJECT7.BAT) 



echo off 
CLS 
init 1 

GRAPHICS 
bat /N /p /s 

smlt PROJA -go = -prs = -Is -ns -plm 6 -bw 

rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 

rep PROJA INTRVAL -outf INTRVL. OUT -bw >NUL 

rep PROJA -t -bw >NUL 

timestmp 

-top dynex PROJA -in PROJA. STT -sc -Is -plm 6 -bw 
smlt PROJA -gm = -ns -plm 6 -bw 
capture 

rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL. OUT -bw >NUL 
rep PROJA -bw >NUL 
call -top 1 
Exit 

goto -top%A 

-topi timestmp 
%A = 1 
ram 
els 



_ * $ $ $ \/jp\y PROJA STATUS REPORT ******************** 

rep PROJA PROJA -outf JUNK. OUT -t -sc -Is -plm 6 -bw 
INKEY %0 
bat /p /s 
els 

color \ 1 F 



-4~1 **** VIEW GRAPHIC STAFFING PLOT **** 
BAT CLS 
BAT COLOR \1F 
BAT BEGTYPE 
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****************************************************************** 



\ 1 A GRAPHICALLY DISPLAYED VARIABLES \1F 

****************************************************************** 



THE FOLLOWING VARIABLES WILL BE PLOTTED: 

WFS STAFF LEVEL YOU REQUESTED 

FTEQWF CURRENT STAFF LEVEL 

FRWFEX PERCENT OF STAFF THAT IS EXPERIENCED 

CMTRMD CUMULATIVE PERSON-DAYS SPENT ON 

TRAINING NEW STAFF 

\ 1 A AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE \1F 
\ 1 A PRESS <ENTER> TO VIEW PLOT \1F 



END 

BAT INKEY %0 
BAT CLS 

REP PROJA PROFXPLA 
BAT /p /s 
color \1F 



ram 

els 

begtype 

+ + 

+ + \ 1 A REVIEW MENU \ 1 F+ + 

] 

] 

] 

] \ 1 F THIS MENU ALLOWS YOU TO REVIEW THE 

] STATUS REPORT AND STAFFING PLOT AGAIN 

] \1F 

] 

] 

] \1D 1 \ 1 F VIEW YOUR SUBSYSTEM STATUS REPORT AND 

] PLOT AGAIN 

] 

] \ 1 D 2 \ 1 F PROCEED TO SIMULATE NEXT TIME PERIOD 

] 



Choose an option: (DO NOT HIT <ENTER> AFTER SELECTION!!!!) ; 



] 

-] 

] 

] 

] 

] 

] 

] 

] 

] 

] 

] 

] 
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-lstkeyl inkey %0 | if %0 # = 1 type %0; 
if %0 = keyOlb return 
goto -%0~1 

-2ndkeyl inkey %1 | if %1 # = 1 type %1; 
if % 1 = keyOlb return 
if % 1 = key020 goto -$%0$1 
if %1 = keyOOd goto -$%0$1 
if % 1 = key008 goto -topi 
if % 1 = key 14b goto -topi 
goto -%0% 1 1 



- 2~1 



**** PROCEED WITH NEXT SIMULATION 






BAT CLS 
BAT COLOR \1F 
BAT BEGTYPE 






* 

* 

* 

* 

* 



* 

* 

WRITE YOUR NEW DESIRED STAFFING LEVEL ON THE * 

DOCUMENTATION SHEET PROVIDED. * 

* 



* PRESS <ENTER> * 



END 

bat /p /s goto -top 



-% 0~1 

-$% 0$1 

-%0% 1 1 beep goto -top 
-on.error- 

if %R > 82 if %R < 90 type !! Floating Point Error !! |goto -Calc. 
Cls beep type Unexpected batch file error %R in line %L |exit 
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APPENDIX C: BATCH CONTROL FILE (TEST.BAT) 

echo off 
CLS 
init 1 

GRAPHICS 
bat /N /p /s 

smlt TEST -go = -prs = -Is -ns -plm 6 -bw 

rep TEST INTRVAL -outf INTR V AL. OUT -t -bw >NUL 

rep TEST INTRVAL -outf INTR VL. OUT -bw >NUL 

rep TEST -t -bw >NUL 

timestmp 

-top dynex TEST -in TEST.STT -sc -Is -plm 6 -bw 
smlt TEST -gm = -ns -plm 6 -bw 
capture 

rep TEST INTRVAL -outf INTRVAL. OUT -t -bw >NUL 
rep TEST INTRVAL -outf INTRVL.OUT -bw >NUL 
rep TEST -bw >NUL 
call -top 1 
Exit 

goto -top%A 

-topi timestmp 
%A = 1 
ram 
els 



_1~] **** view TEST STATUS REPORT ******************** 
rep TEST TEST -outf JUNK. OUT -t -sc -Is -plm 6 -bw 
INKEY %0 
bat /p /s 
els 

color \1F 



-4~1 **** VIEW GRAPHIC STAFFING PLOT **** 
BAT CLS 
BAT COLOR \1F 
BAT BEGTYPE 



42 



****************************************************************** 



\1A GRAPHICALLY DISPLAYED VARIABLES \1F 

****************************************************************** 

THE FOLLOWING VARIABLES WILL BE PLOTTED: 

WFS STAFF LEVEL YOU REQUESTED 

FTEQWF CURRENT STAFF LEVEL 

FRWFEX PERCENT OF STAFF THAT IS EXPERIENCED 

CMTRMD CUMULATIVE PERSON-DAYS SPENT ON TRAINING 

NEW STAFF 

\ 1 A AFTER VIEWING PLOT PRES S <ESC> TO CONTINUE \ 1 F 
\ 1 A PRESS <ENTER> TO VIEW PLOT \ 1 F 
END 

BAT INKEY %0 
BAT CLS 

REP TEST TESTFXPL 
BAT /p /s 
color \1F 
ram 
els 

begtype 

+ + 

+ + \1 A REVIEW MENU \1F+ + 

] \1 A \1F 

] 

] 

] \1F THIS MENU ALLOWS YOU TO REVIEW THE 

] STATUS REPORT AND STAFFING PLOT AGAIN 

] \1F 

] 

] \1D 1 \1F VIEW YOUR SUBSYSTEM STATUS REPORT AND 

] PLOT AGAIN 

] 

] \1D 2 \1F PROCEED TO SIMULATE NEXT TIME PERIOD 

+ 

Choose an option: (DO NOT HIT <ENTER> AFTER SELECTION!!!!) ; 
end 

-lstkeyl inkey %0 | if %0 # = 1 type %0; 
if %0 = keyOlb return 



] 

-] 

] 

] 

] 

] 

] 

] 

] 

] 

] 
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goto -%0~ 1 



-2ndkeyl inkey %1 | if % 1 #= 1 type%l; 
if % 1 = keyOlb return 
if % 1 = key020 goto -$%0$1 
if % 1 = keyOOd goto -$%0$1 
if % 1 = key008 goto -topi 
if % 1 = key 14b goto -topi 
goto -%0% 1 1 

-2-1 **** PROCEED WITH NEXT SIMULATION ******************** 
BAT CLS 
BAT COLOR \1F 
BAT BEGTYPE 

* * 

* WRITE YOUR NEW DESIRED STAFFING LEVEL ON THE * 

* DOCUMENTATION SHEET PROVIDED * 

* * 

* PRESS <ENTER> * 

END 

bat /p /s goto -top 



-% 0~1 

-$% 0$1 

-%0% 1 1 beep goto -top 
-on error- 

if%R > 82 if%R < 90 type !! Floating Point Error !! |goto -Calc. 
Cls beep type Unexpected batch file error %R in line %L |exit 
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APPENDIX D: EXPERIMENT PARTICIPATION GUIDELINES 



******** D Q N0T start the NETWORK!!!********* 

***READ INSTRUCTIONS IN THEIR ENTIRETY BEFORE DOING ANYTHING!!!*** 

A. TRIAL RUN 



This TRIAL RUN portion (1 thru 15) of the instruction set will take you through both the 
initial set up and training portions of the experiment. Follow the instructions carefully . If 
any problems arise, immediately seek out the lab attendant. 

1) Insert the disk into the appropriate drive. 

2) . From the c:\> prompt change to the appropriate drive (ex: b: press <ENTER>) 

3) Type TESTat the b:\> prompt to begin the trial run. (ex:TESTpress <ENTER>) 

4) You are now looking at the PERSONAL IDENTIFICATION screen. Enter your Last 
name, press <ENTER>, then enter your SMC number, press <ENTER>. 

5) . You are now looking at the INTRODUCTORY SCREEN. Please ensure you read it 
carefully and follow the rules completely!. Press <ENTER> 

6) . You are now looking at the INITIAL STAFFING LEVEL screen. You can keep the 
number shown or change the number to any you desire. Press <ENTER> 

7) . You are now looking at the ENSURE YOUR ANSWER screen. This screen prompts 
you to document your entry on the document sheet, and allows you to verify the answer 
you have entered OR change the answer if you like. Press <ENTER> 

8) . This next screen tells you that you are about to run the interval with the staffing level 
you have chosen. There is a moderate pause. Press <ENTER> 

9) The system will now generate the project report for a period of forty days.. Review 
this report to become acquainted with the displayed information. Press <ENTER> 

10) . You are now looking at the GRAPHICALLY DISPLAYED VARIABLES screen. 
This screen shows you the variables that are going to show up on the plot. It is important 
that you know these variables and how they relate to each other. These acronyms . their 
meanings and their scale follow . Press <ENTER> 
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WFS ... STAFF LEVEL YOU REQUESTED (0 to24) 

FTEQWF CURRENT STAFF LEVEL (0 to 24) 

FRWFEX PERCENT OF STAFF THAT IS 

EXPERIENCED (0 to 100) 

CMTRMD CUMULATIVE PERSON-DAYS SPENT ON 

TRAINING NEW STAFF (0 to 150) 



11) . You are now looking at the VARIABLES PLOT. Take a moment to review the 
scale of each variable (labeled at top of screen) and how the colored lines vary over time. 

- Press <ESC> (pressing anything other than ESC will regenerate the plot) 

12) You are now looking at the REVIEW MENU. This menu allows you to press (1) to 
return to the status report and plot perhaps for another look OR to press (2) to proceed to 
the next interval. (DO NOT PRESS ENTER AFTER HITTING THE DESIRED 
NUMBER). Press (2) 

13) You are now looking at the PROCEED THROUGH NEXT INTERVAL SCREEN 
with a prompt for you to document your staffing level. Press <ENTER>. 

14) . You are now at the CHANGE STAFFING LEVEL screen. Continue through at least 
two more intervals to become comfortable with the experiment. 

15) After you are familiar with the system, proceed until you are looking at the REVIEW 
MENU. PRESS <ESC>. You will see the Drive Prompt appear. 

16) Proceed to section 2. 

2. TO RUN THE EXPERIMENT: 



1) . Follow instructions on the screens as illustrated above in the TRIAL RUN portion. 
Ensure that you enter your staff decisions on the attached documentation sheet when 
prompted. 

2) . The experiment is complete when the (% Development Reported Complete" and % 
Test Reported Complete" both = 100 OR the generated reports cease to increment to 
another 40 day interval (IN EITHER CASE. CHECK WITH THE LAB 
ASSISTANT BEFORE STOPPING) 

3) Upon clearance from the lab attendant, exit the system by continuing to the review 
menu and pressing <ESC>. Take the disk from the machine and place it and all 
documentation, including your scratch paper, in the folder provided. 

4) . Type: PROJECTA to begin the experiment. 
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GOOD LUCK!!! 



APPENDIX E: EXPERIMENT DOCUMENTATION AND 

INSTRUCTION SET 
(SET A) 



YOUR NAME: 
SMC NO 



INTRODUCTION 



The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing . In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 

PROJECT 



The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 

Estimated Project Size (in Number of Tasks*) 

Estimated Project Cost (in Number of Person Days) 

Estimated Duration (in Number of Work Days) 

Size of the Initial Core Team (in People**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements' specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOUR TASK 



Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 

a) complete the project on schedule. 

b) at the lowest possible cost. 

Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 

SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 



Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 

Because all personnel in the organization are already assigned to other projects, any staff 
additions you request will be hired from the outside. As a result, there will be a delay in 
hiring new staff and in assimilating them into your project. 

- The hiring delay will be 3 months (i.e., 60 working-days) on average. 

- The assimilation delay for a newly hired employee is typically 4 months 

(i.e., 80 working-days). This is the time it typically takes to train a new employee 
in the mechanics of the project and bring him/her up to speed. Because the organization 
does not have a formal training program, the training is done on the job by having one 
of the experienced staff members spend 25% of his/her time "hand-holding" the new 
employee. During this 4 month training period, a new employee is typically only half as 
productive as an experienced employee. 
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APPENDIX F: EXPERIMENT DOCUMENTATION AND 

INSTRUCTION SET 
(SET B) 



YOUR NAME: 
SMC NO: 



INTRODUCTION 



The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing . In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 

PROJECT 



The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 

Estimated Project Size (in Number of Tasks*) 

Estimated Project Cost (in Number of Person Days) 

Estimated Duration (in Number of Work Days) 

Size of the Initial Core Team (in People**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements' specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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VO! JR TASK 



Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 

a) complete the project on schedule. 

b) at the lowest possible cost. 

Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 

SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 



Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 

Because all personnel in the organization are already assigned to other projects, any staff 
additions you request will be hired from the outside. As a result, there will be a delay in 
hiring new staff into your project. 

- The hiring delay will be 3 months (i.e., 60 working-days) on average. 

- The new staff are hired from a specific contractor with whom the organization 
has had a long-term relationship. Because the contractor's personnel are very familiar with 
your organization's projects and development environment, they can be assimilated and 
brought up to speed very quickly. The assimilation delay for a newly hired employee is 
typically 1 2 days. This is the time it typically takes to train the employee in the mechanics 
of the project and bring him/her up to speed. During this 12 day training period, the 
employee is typically less productive than an employee already on the project Because we 
do not have a formal training program, the training is done on the job by having one of the 
experienced staff members spend 25% of his/her time "hand-holding" the new employee. 
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APPENDIX G: EXPERIMENT DOCUMENTATION AND 

INSTRUCTION SET 
(SET C) 



YOUR NAME: 
SMC NO: 



INTRODUCTION 

The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing . In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 

PROJECT 

The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 

Estimated Project Size (in Number of Tasks*) 

Estimated Project Cost (in Number of Person Days) 

Estimated Duration (in Number of Work Days) 

Size of the Initial Core Team (in People**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements' specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 



51 



YOUR TASK 



Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 

a) complete the project on schedule. 

b) at the lowest possible cost. 

Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 



SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 



Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 

Because your project is a high priority project, any staff additions you request will be 
transferred to you from other ongoing projects within the organization rather than hiring 
people from the outside. This will minimize the delays in transferring new people to the 
project. 



- The transfer delay will be 9 days on average. 

- The assimilation delay for a newly transferred employee is typically 80 days. 
This is the time it typically takes to train the transferee in the mechanics of the project and 
bring him/her up to speed. Because we do not have a formal training program, the 
training is done on the job by having one of the experienced staff members spend 25% of 
his/her time hand-holding" the transferee. During this 80 day training period, the transferee 
is typically less productive than an employee already on the project. 
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APPENDIX H: EXPERIMENT DOCUMENTATION AND 

INSTRUCTION SET 
(SET D) 



YOUR NAME: 
SMC NO: 



INTRODUCTION 



The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing . In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 

PROJECT 



The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 

Estimated Project Size (in Number of Tasks*) 

Estimated Project Cost (in Number of Person Days) 

Estimated Duration (in Number of Work Days) 

Size of the Initial Core Team (in People**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements' specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOIJR TASK 



Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 

a) complete the project on schedule. 

b) at the lowest possible cost. 

Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 

SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 



Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 

Because the project is a high priority project, any staff additions you request will be 
transferred to you from other ongoing projects within the organization rather than hiring 
people from outside. This will minimize the delays in transferring and assimilating new 
people to the project. 

- The transfer delay will be 9 days on average. 

- The assimilation delay for a newly transferred employee is typically 12 days. 
This is the time it typically takes to train the transferee in the mechanics of the project and 
bring him/her up to speed. During this 12 day training period, a transferee is typically less 
productive than an employee already on the project. Because we do not have a formal 
training program, the training is done on the job by having one of the experienced staff 
members spend 25% of his/her time "hand-holding" the transferee. 
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APPENDIX I: SAMPLE RANDOMIZED POPULATION WORKSHEET 
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SAMPLE RANDOMIZED POPULATION WORKSHEET 
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APPENDIX J: SEATING CHARTS 
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APPENDIX J: SEATING CHARTS 
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APPENDIX K: EXPERIMENT DECISION RECORD SHEET 



Initial Project Estimates 

Estimated Project Size (397 Tasks*) 

Estimated Project Cost (1,111 Person Days) 

Estimated Duration (320 Working Days) 

Size of the Initial Core Team. ...(3.5 Full Time Equivalent Personnel**) 

* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 

Please enter your project staffing decisions below: Your initial decision is the initial staff 
level provided by the system or the change you make to that level. 

STAFFING (FULL TIME EQUIVALENT PERSONNEL) 

Initial Decision : 

Time Elapsed - 40 days: 

Time Elapsed - 80 days: 

Time Elapsed - 120 days: 

Time Elapsed - 160 days: 

Time Elapsed - 200 days: 

Time Elapsed - 240 days: 

Time Elapsed - 280 days: 

Time Elapsed - 320 days: 

Time Elapsed - 360 days: 

Time Elapsed - 400 days: 

Time Elapsed - 440 days: 

Time Elapsed - 480 days: 

Time Elapsed - 520 days: 

****WHEN YOU ARE DONE, CALL FOR A LAB ATTENDANT **** 
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APPENDIX L: DEMOGRAPHIC SAS CONTROL FILE 



libname datename "c:\sas\saswork\"; 
data demograp.dat; 
infile "c:\sas\saswork\demofile.txt"; 

input NUMBER 1-7 NAME $ 19-12 SMC 16-19 PROJ $ 24-27 CURRIC $ 40-42 SEX $ 
48-50 AGE $ 55-58 WORK $ 62-66 YEARS $ 70-74 COMP $ 79-83 HOURS $ 87-93 
GRADE; 
list, 

proc print; 

title 'Demographic profiles' 
proc means; 
var GRADE; 
by proj; 

title 'Statistics for individual project groups'; 
proc anova; 
classes proj; 
model GRADE=PROJ; 
title 'Grades ANOVA for different teams' 
run; 
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APPENDIX M: SAS GLM AND REPEATED MEASURES CONTOL FILE 



DATA REPEATED (KEEP = LNAME PROJECT PERIOD STAFF); 
INFILE "PROC1 DAT"; 

input lname $ project $ period S naive opthd optad optha wfneed cummd 
pdvrc ptktst pjbsz cmtkdv cummd schcdt timerm fteqwf frwfex 
time staff; 

if(lname— WEATHERF') then delete; 



/* Description of data fields 

opthd: Optimal hiring delay. 

optad: optimal assimilation delay. 

optha: optimal hiring and assimilation delay. 

wfneed: NASA's decision. 

cummd: mandays expended to date. 

pdvrc. percentage development complete. 

pktst: percentage testing complete. 

pjbsz: perceived job size. 

cmtkdev: cumulative tasks developed. 

schcdt: scheduled completion date. 

timerm: time remaining. 

fteqwf: current workforce size. 

frwfex: percentage workforce size. 

Project. A - Hiring+Assimilation delay. 

B - Hiring delay. 

C - Assimilation delay. 

D - No delay. 

*/ 



if ((period NE '0.00') 
and (period NE '40.00') 
and (period NE '80.00') 
and (period NE '120.00') 

AND (PERIOD NE '160.00') 
AND (PERIOD NE '200.00')) 

/* AND (PERIOD NE '240.00'))*/ 
then delete; 
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/* THIS CODE WAS FOR INITIAL ANALYSIS PORTION*/ 



IF (PROJECT = 'A') THEN OPTIMAL=OPTHA; 

ELSE IF (PROJECT = B') THEN OPTIMAL=OPTHD; 

ELSE IF (PROJECT = ’C’) THEN OPTIMAL=OPTAD; 

ELSE IF (PROJECT = ’D’) THEN OPTIMAL=NAIVE; 

IF (OPTIMAL < 0) THEN OPTIMAL = MIN (FTEQWF, NAIVE); 

DOPTIMAL = ABS(STAFF-OPTIMAL); 

POPTIMAL = ABS(STAFF-OPTIMAL)/OPTIMAL; 

DIFNAIVE = ABS(STAFF-NAIVE); 

PDFNAIVE - ABS(STAFF-NAIVE)/(NAIVE); 



PROC SORT; 

BY PROJECT PERIOD; 



PROC PRINT; TITLE ’ MJB THESIS STATS ’ 
VAR LNAME PROJECT PERIOD; 



PROC MEANS; BY PROJECT PERIOD, 

TITLE 1 THESIS MEANS LISTING', 
proc glm; 

CLASS PROJECT PERIOD; 

MODEL STAFF NAIVE OPTAD OPTHD OPTHA 

TIME = PROJECT PERIOD PROJECT*PERIOD; TITLE 'GLM STATS'; 
MODEL OPTIMAL DOPTIMAL POPTIMAL= PROJECT PERIOD 
PROJECT *PERIOD; 

/* THIS IS A SECOND PORTION OF CODE WORKING TOWARDS REPEATED 
MEASURES*/ 

PROC SORT DAT A=REPEATED OUT=SORT; 

BY PROJECT LNAME PERIOD; 

PROC TRANSPOSE DATA=SORT OUT=TRANS; 

BY PROJECT LNAME; 

ID PERIOD; 
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PROC PRINT DATA=TRANS; 



PROC GLM DATA=TRANS; 

CLASS PROJECT; 

MODEL _0D00 _40D00 _80D00 _120D00 _160D00 _200D00=PROJECT/NOUNI; 

MEANS PROJECT/SCHEFFE; 

REPEATED PERIOD POLYNOMIAL/SHORT SUMMARY; 

PROC MEANS; 

VAR _0D00 _40D00 _80D00 _120D00 _160D00 _200D00; 

BY PROJECT; 

run; 
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APPENDIX N: SAS DEMOGRAPHIC FILE 



SMC 

NAME BOX 


PROJ 

ID 


PROJ 

EXP 


CURRIC 


SEX 


BENNETT 1559 


D 


N 


370 


M 


BIGGS 1401 


D 


N 


370 


M 


BOWER 1810 


B 


N 


370 


F 


BRYANT 2798 


B 


N 


370 


M 


BUNN 2373 


A 


N 


370 


M 


BUXTON 2910 


B 


Y 


370 


M 


CARLSON 2962 


D 


N 


370 


M 


CARVER 2306 


B 


Y 


370 


F 


CELIA 1557 


A 


N 


370 


M 


CLANCY 2904 


C 


N 


370 


M 


CONROY 1286 


C 


N 


370 


M 


CRAWFOR 2089 


D 


N 


370 


F 


DAY 1337 


C 


N 


370 


M 


DEVRIES 1659 


B 


N 


370 


M 


DILLS 2893 


B 


N 


370 


M 


DWIGGIN 2434 


C 


N 


370 


M 


FREEMAN 1020 


B 


N 


370 


M 


FULLER 1259 


D 


N 


370 


M 


GAMBRIN 2189 


C 


N 


370 


M 


HOLLOWE 1191 


C 


Y 


370 


M 


HUBBARD 1110 


D 


N 


370 


M 


JOHNSON 2986 


A 


N 


370 


M 


LANDAU 2271 


A 


Y 


370 


M 


LEE 2847 


A 


N 


370 


M 


LOGAN 2432 


A 


Y 


370 


M 


LOVELAC 1054 


C 


N 


370 


M 


LOVELES 2911 


A 


N 


370 


M 


MCDERM1 1313 


D 


Y 


370 


M 


MCGAHA 1064 


C 


Y 


370 


M 


MEISCH 1294 


B 


V' 


370 


M 


NEIL AN 2628 


D 


Y 


370 


F 


OTT 2913 


A 


N 


370 


M 


QUINN 1937 


D 


N 


370 


M 


RUSSELL 2167 


D 


N 


370 


M 


RUSSO 2213 


B 


Y 


370 


M 


SAND JO J 2111 


D 


N 


370 


M 


SHADLE 2145 


A 


Y 


370 


M 


SMITH 2332 


C 


Y 


370 


F 


SPEGELE 2796 


A 


N 


370 


M 


STEWART 1409 


D 


Y 


370 


M 


SUHADI 2087 


B 


Y 


370 


M 


SWANSON 1515 


C 


Y 


370 


M 


SWEENEY 2905 


D 


N 


370 


M 


SWETT 1088 


B 


N 


370 


M 


THERRIA 1099 


A 


Y 


370 


M 


TILLERY 1879 


B 


N 


370 


F 


TSONGAS 2016 


A 


N 


370 


M 


TUTT 1443 


A 


N 


370 


M 


VANNED 1143 


C 


Y 


370 


F 


WALSH 1377 


C 


Y 


370 


M 


WALTERS 1551 


C 


Y 


370 


F 


WEATHER 1553 


B 


N 


370 


M 


WHITTEN 2765 


D 


N 


370 


M 


WIEDEN 1623 


A 


N 


370 


M 



WORK 


YEARS 


COMP 


HOURS 


NUMERIC 


EXP 


SINCE 

GRAD 


FAMIL 


USE 


GRADE 


7 


5 


6 


2 


3.3 


21 


8 


5 


10 


27 


10 


11 


5 


20 


37 


13 


7 


6 


25 


27 


19 


14 


6 


15 


3 3 


14 


10 


5 


12 


3 7 


14 


10 


5 


14 


30 


4 


9 


5 


1 


40 


5 


5 


9 


25 


40 


21 


12 


5 


10 


3.3 


14 


13 


7 


16 


37 


7 


8 


4 


4 


37 


7 


7 


8 


8 


37 


1 1 


11 


5 


5 


3 3 


16 


7 


6 


14 


40 


19 


7 


4 


10 


33 


16 


8 


6 


6 


27 


12 


12 


5 


3 


3 3 


7 


7 


8 


10 


3 0 


10 


4 


5 


2 


3 7 


20 


13 


7 


3 


3 3 


7 


7 


7 


15 


37 


23 


17 


9 


40 


3 0 


10 


6 


8 


15 


3.3 


9 


9 


7 


6 


40 


12 


6 


3 


5 


40 


7 


7 


6 


2 


3 7 


5 


5 


9 


8 


37 


17 


4 


9 


14 


30 


10 


6 


9 


20 


3 0 


7 


7 


6 


5 


33 


6 


6 


7 


10 


40 


6 


6 


7 


15 


40 


8 


8 


9 


20 


27 


16 


16 


7 


10 


33 


17 


17 


9 


30 


27 


23 


23 


7 


10 


40 


8 


8 


7 


12 


30 


7 


5 


7 


7 


40 


13 


14 


4 


15 


3 7 


19 


19 


6 


5 


33 


11 


11 


6 


5 


40 


9 


9 


8 


10 


40 


16 


10 


9 


10 


40 


11 


9 


7 


13 


37 


12 


9 


3 


1 


40 


8 


12 


7 


10 


33 


5 


5 


6 


12 


30 


6 


6 


7 


12 


3 7 


17 


17 


9 


4 


30 


20 


17 


7 


25 


40 


18 


5 


8 


13 


33 


8 


8 


5 


8 


37 


17 


10 


1 


1 


40 



AGE 

28 

39 

32 

35 

42 

32 

32 

31 

27 

39 

33 

30 

28 

33 

35 

37 

33 

35 

30 

31 

37 

30 

42 

28 

31 

28 

30 

26 

30 

28 

29 

28 

28 

29 

37 

41 

44 

31 

29 

36 

43 

33 

31 

32 

32 

33 

29 

27 

28 

37 

39 

37 

30 

34 
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APPENDIX 0: SAS DATA FILE 



BENNETT 0 


0.00 


3.47 


3.47 


3 . 47 


3.47 


3.47 


0.00 


0 00 


0.00 


396 . 60 


0 . 00 


0 . 


00 


320 .00 


320.00 


3 . 47 


100.00 


436 


' 50 


BENNETT D 


40 .00 


3.60 


3 60 


3.60 


3.50 


3.50 


139.75 


9 69 


0.00 


402 .31 


44 .65 


139 . 


75 


317 50 


277.60 


3.50 


99 93 


701 


7.00 


BENNETT D 


80.00 


7.10 


7.12 


7.12 


7 . 1 3 


7.10 


388 .57 


28 . 59 


0.00 


426.43 


111.91 


388 . 


57 


189.12 


109.12 


6.96 


96 . 40 


44 3 


7 00 


BENNETT D 


120.00 


•7.26 


7.29 


7.29 


7.32 


7.26 


668 26 


47.12 


0.00 


505.86 


201.21 


668 . 


26 


212 61 


92 .61 


7.00 


99 80 


527 


7.00 


BENNETT D 


160 .00 


7.17 


7.20 


7.20 


7.23 


7.17 


948 . 24 


61 .64 


0.00 


676.63 


303 .16 


948 . 


24 


234 .61 


74 61 


7.00 


99 . 99 


447 


7 00 


BENNETT D 


200.00 


7 . 08 


7.10 


7.10 


7 .14 


7.08 


1228.24 


77.55 


0.00 


604.76 


421.03 


1228 . 


24 


243.28 


43 . 28 


7.00 


100.00 


906 


6.3C 


BENNETT D 


240.00 


6 .34 


6.36 


6.35 


5.25 


5.33 


1466 95 


93 .06 


0.00 


609.91 


578.07 


1456 . 


95 


266.90 


16.90 


6 . 33 


100.00 


367 


3 60 


BENNETT D 


279 . 00 


14.22 


3 . 33 


3.33 


3.43 


3.73 


1611 . 40 


100.00 


100 . 00 


610.00 


609 .93 


1611 . 


40 


279.17 


0.17 


3.63 


100.00 


166 


3 50 


BIGGS D 


0.00 


3.47 


3 . 47 


3 47 


3.47 


3 . 47 


0.00 


0.00 


0.00 


396.60 


0.00 


0. 


00 


320.00 


320.00 


3 . 47 


100 .00 


1 46 


3.60 


BIGGS D 


40.00 


3.60 


3.60 


3.50 


3 . 50 


3.50 


139.75 


9.69 


0.00 


402.31 


44 .65 


139 . 


75 


317.50 


277.60 


3.50 


99 .93 


264 


6.60 


BIGGS D 


80.00 


6.67 


6 . 67 


6 . 67 


5.68 


5.57 


341.93 


25.71 


0.00 


424.79 


101 . 40 


341 . 


93 


227.06 


147.06 


6 • 48 


96 .66 


332 


5.60 


BIGGS D 


120 . 00 


6.67 


6.69 


6.69 


5.70 


5.67 


661 .74 


40 . 57 


0.00 


491 . 11 


171.11 


661 . 


74 


253.09 


133.09 


5.50 


99 .85 


23C 


5.60 


BIGGS D 


160.00 


6.63 


6.64 


5 .64 


5.66 


5.63 


781 .74 


61.60 


0.00 


660.55 


248 .11 


781 . 


74 


282 .28 


122 . 28 


5.50 


99 99 


220 


4 60 


BIGGS D 


200 .00 


4.66 


4 66 


4.55 


4.56 


4 55 


971 57 


61.76 


0.00 


596 83 


320.37 


971 . 


57 


326 08 


126.08 


4.52 


100.00 


200 


4 60 


BIGGS D 


240.00 


4.60 


4.60 


4.60 


4.50 


4.60 


1161.73 


72.82 


0.00 


607.90 


397.67 


1161 . 


73 


329 28 


89.28 


4 60 


100.00 


231 


6 00 


BIGGS D 


280.00 


6 . 00 


6.00 


6.00 


5.01 


5.00 


1347.28 


86.36 


0.00 


609.88 


498 .98 


1 347 . 


28 


321.24 


41.24 


4 . 99 


99 . 08 


217 


6 . 40 


BIGGS D 


120 0C 


9 89 


4 33 


4.33 


4 .92 


8.96 


1559.67 


98 16 


63.06 


610.00 


609 . 58 


1569 


67 


321.72 


1 .72 


5.40 


99 .28 


410 


‘ 40 


BIGGS D 


127.00 


342.76 


5.19 


5.19 


5.29 


275.28 


1697 . 46 


100 .00 


100.00 


610.00 


609.91 


1697 . 


46 


327.01 


0 . 01 


5 40 


99 . S' 


162 


6 40 


BOWER B 


0.00 


3 . 47 


3.47 


3.47 


3 . 47 


3.47 


0.00 


0.00 


0.00 


396.50 


0.00 


0. 


00 


320.00 


320 00 


3.47 


100.00 


10 5 


j 50 


BOWEP. B 


40.00 


3.60 


3 . 60 


3.50 


3.51 


3.50 


139.17 


9 66 


0.00 


402 . 30 


44.63 


139. 


17 


317.64 


277.64 


3 . 49 


99 .90 


281 


6.00 


BOWER b 


80 .00 


6 11 


7 . 16 


6.21 


7 . 48 


6 .11 


305 65 


23 . 30 


0.00 


423.72 


92 .69 


305. 


55 


219 . 48 


139 48 


4 7 1 


93 bl 


285 


7.0C 


BOWER B 


120.00 


7.26 


9 11 


7.39 


9 89 


7.26 


518 . 66 


37 63 


0.00 


479.61 


156.96 


518 . 


56 


226.56 


10b 66 


5.83 


96 13 


2b0 


9 00 


BOWER B 


160.00 


9.36 


20.16 


9.65 


76.33 


8 .43 


785 . 70 


51.62 


0.00 


651.63 


2 44 17 


785 . 


70 


231 .05 


71 06 


7 .38 


94 73 


288 


7 00 


BOWER b 


200.00 


7.11 


9.14 


7.12 


4 86 


7.05 


1069 . 40 


67.06 


0.00 


595.35 


352.02 


1069 . 


40 


265 . 89 


65 .69 


7 .01 


100 00 


238 


4 00 


BOWER B 


240.00 


4.00 


3.77 


3.99 


3 . 31 


4.00 


1268 . 96 


79.92 


0.00 


608.45 


437.26 


1258. 


96 


314.49 


74 49 


4 . 06 


ICO 00 


294 


6.00 


BOWER B 


280 .00 


6 47 


3.75 


6.97 


3.91 


6.13 


1431.13 


90 41 


0 . 00 


609.98 


660.04 


1431 . 


13 


306 . 66 


26.56 


4 51 


97 .46 


191 


b . 0C 


BOWER B 


320 .00 


12.78 


6.09 


4 .16 


5.11 


11 .20 


1627.59 


99 16 


73.65 


610.00 


609.74 


1627 . 


59 


321.13 


1-13 


6.24 


96 5 J 


223 


9 90 


BOWER B 


126 . 00 


1141 . 92 


5.60 


5-60 


6.60 


2674.65 


1660 . 03 


99 .49 


93 .79 


610.00 


609 . 90 


1660 . 


03 


326.96 


0.00 


5.60 


92 94 


*09 


-*.0C 


BRYANT B 


0.00 


1 . 47 


3 .47 


3.47 


3.47 


3 47 


0.00 


0.00 


0.00 


396.50 


0.00 


0 . 


00 


320.00 


320.00 


3 . 47 


100 00 


58 


' SC 


BRYANT B 


40.00 


1.60 


3.50 


3 . 50 


3 .51 


3 . 50 


139.17 


9.65 


0 . 00 


402.30 


44.53 


139 . 


17 


317.64 


277 .64 


3 . 49 


99 90 


351 


4 *0 


BRYANT B 


90.00 


4 .26 


4 42 


4 27 


4 46 


4 25 


286.25 


22 21 


0 .00 


423 49 


88.34 


266 . 


26 


284 94 


204 94 


3.83 


97 77 


2b2 


4 2* 


BRYANT B 


120 .00 


4 32 


4 46 


4.34 


4 . 49 


4.32 


443. 7 6 


33 21 


0.00 


470.97 


137.26 


443 


76 


312 .2 7 


192 . 2 7 


4.02 


98 7 0 


„• 12 


4 0C 


BRYANT B 


160 .00 


4 . 09 


4 .12 


4.09 


4.13 


4 . 09 


603 .9 7 


41 35 


0 . 00 


634 .46 


190.69 


b0 3 


9 7 


361 .2 7 


201 21 


4 . 00 


100 .00 


2" 1 6 


4 ”C 


BRYANT B 


200 .00 


4.77 


5.04 


4 .60 


5.11 


4 77 


771.48 


49 . 37 


0 00 


679.04 


249.64 


771 . 


48 


358 44 


168.44 


4 34 


9b . 07 


2 ib 


7 .00 


BRYANT B 


240.00 


7.11 


10.78 


7.28 


13.89 


6 . 81 


973.64 


60.05 


0 . 00 


601 . 34 


323.60 


973 . 


64 


323 93 


83 .93 


6 b 4 


94 31 


26 j 


8 10 


BRYANT B 


280 . 00 


8 . 26 


3.60 


8 66 


4.67 


7.97 


1226 . 67 


76 . 46 


0 .00 


608 .71 


423 .69 


1226 . 


57 


321 68 


41 . 68 


b . 84 


95 .64 


217 


10 .20 


BRYANT B 


120.00 


13.30 


8 . 26 


6.60 


8.29 


1232 


1535.17 


94 56 


19 44 


609.98 


606 47 


1536 . 


17 


322.62 


2.62 


8 . 48 


95 14 


354 


10.20 


BRYANT B 


129.00 


2329 . 83 


8 72 


8.72 


8.72 


1865 .61 


1612 . 63 


100 .00 


100 . 00 


610.00 


609 .95 


1612 . 


63 


328 91 


0.00 


8 72 


96.86 


209 


10 20 


BUNN A 


0.00 


3 47 


3 47 


3 47 


3.47 


3.47 


0.00 


0.00 


0.00 


396.50 


0.00 


0 . 


00 


320.00 


320.00 


J . 47 


100.00 


338 


5 00 


BUNN A 


40.00 


6.02 


6 . 39 


6.39 


6 . 39 


4.97 


156.25 


10 . 59 


0.00 


402.36 


46 .66 


156 . 


26 


230 . 32 


190 .32 


4.22 


8b 43 


470 


5 . 00 


BUNN A 


80.00 


6.06 


5 .33 


5.33 


6 . 36 


4.97 


332.34 


25.61 


0 .00 


424.21 


92.05 


332. 


34 


243 .18 


163.18 


4 60 


86.10 


616 


4.50 


BUNN A 


120.00 


4.61 


4 .67 


4 .67 


4.90 


4.59 


513.31 


38 . 37 


0.00 


476.05 


143.40 


513 . 


31 


286.02 


166.02 


4 . 50 


92.88 


315 


4 60 


BUNN A 


160 . 00 


4 .60 


4 66 


4 66 


4 91 


4.67 


693 .33 


47.74 


0.00 


540 40 


200.52 


693 . 


33 


317 .51 


157 . 61 


4 . 60 


95 . 71 


252 


4.70 


BUNN A 


200 00 


4.77 


4 . 91 


4.91 


6 . 49 


4 .73 


875 47 


57.04 


0.00 


583 . 43 


264.07 


876 . 


47 


331.69 


131 69 


4 60 


95 83 


252 


6 00 


BUNN A 


240.00 


6.06 


9.03 


9.03 


3.96 


5 .87 


1074 40 


68 . 34 


o.oo 


603.36 


338.02 


1074 . 


40 


315.66 


76.66 


6.28 


87 .86 


381 


b .50 


BUNN A 


280 .00 


6.60 


4 84 


4 84 


5.67 


6.42 


1298.73 


82.78 


0 00 


609.13 


437.60 


1298 . 


7 3 


316.47 


36 .4 7 
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